Automated Weather Sensor Quality Control
نویسندگان
چکیده
In this paper, we investigate the application of data mining to existing techniques for quality control/anomaly detection on weather sensor observations. Specifically we adapt the popular Barnes Spatial interpolation method to use time series distance rather than spatial distance to develop an online algorithm that uses readings from similar stations based on current and historical observations for interpolation and we demonstrate that this new algorithm exhibits less model error than the Barnes Spatial interpolation based method. We focus on interpolation, which is a basis for this popular quality control method and other related methods, and examine a dataset of over 233 million temperature observations from California and surrounding areas. Our approach shows improved performance as indicated by mean squared error reduced by approximately one half for predicted values versus reported values.
منابع مشابه
A Probabilistic-spatial Approach to the Quality Control of Climate Observations
Surface weather and climate observations are the backbone of a multitude of analyses, studies and assessments. Errors in the observations do occur; if left unidentified, they can have severe and adverse affects on analyses and the decisions that result from them. Rigorous quality control of climate data is probably the single most important thing an analyst can do to ensure a successful outcome...
متن کاملJ6.3 Comparison of Manual and Automated Quality Control of Operational Hourly Precipitation Data of the National Weather Service
The National Weather Service (NWS) Office of Hydrologic Development operates the collection and dissemination of real-time Hydrometeorological Automated Data System (HADS) and other precipitation gauge data to users at River Forecast Centers (RFCs) and Weather Forecast Offices (WFOs). As most of the data are delivered to the users with minimal quality control (QC) in order to shorten data laten...
متن کاملClutter Characterization and Propagation Measurements During Adverse Weather Conditions
The evaluation of sensor performance under adverse weather conditions is critical for the determination of usability during all weather conditions. The Precisions Armaments Laboratory (PAL) located at the US Army Picatinny Arsenal, New Jersey, USA development will enable automated measurement of propagation effects and clutter characterization under adverse conditions.
متن کاملOnline Monitoring for Industrial Processes Quality Control Using Time Varying Parameter Model
A novel data-driven soft sensor is designed for online product quality prediction and control performance modification in industrial units. A combined approach of time variable parameter (TVP) model, dynamic auto regressive exogenous variable (DARX) algorithm, nonlinear correlation analysis and criterion-based elimination method is introduced in this work. The soft sensor performance validation...
متن کاملPrototype of an Aquacultural Information System Based on Internet of Things E-Nose
Aquaculture is the fastest growing food-producing sector in the World, especially, in P. R. China. In the ongoing process of Internet growth, a new development is on its way, namely the evolution from a network of interconnected computers to a network of interconnected objects that is called the Internet of Things (IoT). Constructing an affordable, easy-to-use, aquaculture information system ba...
متن کامل